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An  optical  implementation  ci  what  is  known  as  a  ^supervised  leamingf  algorithm  was  implemented 
with  volume  phototefiactive  holognmhic  medium  and  a  spatial  light  modulator.  We  investigated 
how  one  could  apply  neural  netwon  principles  to  temiwral  information  using  photorefractive 
media.  For  this  purpose,  the  tranfer  function  and  impulse  response  of  photorefractive  two-beam 
coupling  amplinen  was  derived  and  experimentally  verified.  As  mat  of  the  investigation  on 
temporal  (wocessing  of  information,  we  btiik  and  dem^trated  a  fibor^tic  acoustic  transducer  for 
audio  sound  pfo^sin|.  The  sound  spectra  generated  by  the  transducer  were  stored  in  a  volume 
holographic  medium.  The  sttxed  souiids  were  used  to  recognize  identical  or  similar  sounds  in  real 
time. 
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Final  Report 

Optical  Hidden  Layer  Networks 


A.  Statement  of  the  Problem 

This  research  focused  on  several  aspects  of  information  processing  using  photorefractive  sys¬ 
tems  based  upon  neural  network  principles.  In  many  ways  real-time  holographic  media  seem  ide¬ 
ally  suited  to  neural  network  implementations;  the  question  is,  how  well  in  fact  can  one  design  and 
control  the  behavior  of  these  m^ia  to  obtain  certain  tasks.  The  performance  of  simple  supervised 
learning  algorithms,  which  are  popular  in  the  neural  network  community,  are  one  means  of  com¬ 
paring  implementations.  One  of  our  task  was  to  devise  and  implement  such  an  algorithm  with  pho- 
torefracitive  media.  Also  of  interest  are  dynamic  neural  networks  capable  of  processing  temporal 
information  for  such  tasks  as  speech  processing,  sonar  processing,  and  so  forth.  The  question  is, 
what  is  the  best  way  to  transduce  an  acoustic  signal  onto  an  optical  one.  Finally,  once  one  obtains 
the  acoustic  signal,  to  processes  that  signal  holographically  one  needs  to  understand  how  hologram 
formation  dynamics  can  be  used  to  advantage.  In  this  regard,  the  dynamical  properties  of  photore¬ 
fractive  two  beam  coupling  needed  to  be  characterized. 


B.  Summary  of  Most  Important  Results 

We  implemented  what  is  known  as  a  “supervised  learning”  algorithm  with  a  photorefractive 
holographic  medium  and  a  spatial  light  modulator.  We  investigated  how  one  could  apply  neural 
networic  principles  to  temporal  information  using  photorefractive  media.  As  part  of  the  latter  in¬ 
vestigation,  we  built  and  demonstrated  a  fiber-optic  acoustic  transducer  for  audio  sound  process¬ 
ing.  The  sound  spectra  generated  by  the  transducer  were  stored  in  a  volume  holographic  medium. 
The  stored  sounds  were  used  to  recognize  identical  or  similar  sounds  in  real  time.  In  the  following 
sections  we  describe  the  most  significant  aspects  of  each  portion  of  the  work. 

B.l.  Using  volume  hologrphic  media  for  neural  network  learning 

Perhaps  the  most  attractive  feature  of  photorefractive  materials  for  imbedding  neural  net¬ 
works  is  that  they  are  dynamics  holographic  me^a  that  function  at  very  low  light  power  levels.  By 
the  very  nature  of  the  holography,  information  can  be  stored  and  read  in  a  parallel  fashion.  Thus, 
our  first  tasks  was  in  principle  a  very  simple  one,  as  shown  in  Figure  1.  A  liquid  crystal  spatial 
light  modulator,  driven  by  a  computer,  imposed  one  dimensional  spatial  information  onto  a  light 
beam  which  was  split  into  two  portions.  The  two  light  beams  intersected  in  photorefractive  lithium 
niobate.  A  shutter  controlled  the  state  of  one  of  the  beams  (on  or  ofO-  We  will  call  these  two  beams 
A  and  B  with  the  shutter  controlled  one  being  B.  With  B  in  the  off  state,  a  video  camera  read  the 
intensity  of  light  scattered  from  beam  A  by  the  hologram.  The  camera’s  output  was  recorded  by  a 
computer.  This  data  could  be  manipulated  and  used  to  determine  some  new  patterns  to  be  imposed 
on  the  liquid  crystal  nnodulator. 

The  object  of  this  experiment  was  to  perform  what  is  known  as  Adaline  learning  on  a  set  of 
input  vectors.  In  this  task,  one  has  a  desired  mapping  between  a  set  of  input  vectors  {A}  and  an¬ 
other  set  {fl} .  The  system  is  to  learn  this  mapping  by  selecting  a  member  of  A,  then  reading  the 
light  scatter^  by  the  hologram  (corresponding  to  the  output  space).  Given  that  the  output  is  not 
the  desired  one,  there  is  a  simple  algorithm  c^led  the  delta-rule  from  which  one  can  generate  an 
"error"  vector  to  be  placed  on  beam  B.  One  then  updates  the  hologram  by  exposing  the  material  to 
the  interference  of  input  vector  A  with  the  error  vector  B.  The  process  is  repeated  with  another 
member  of  the  set  A,  and  though  each  input  vector  many  times.  It  has  been  shown  that  under  the 
proper  circumstances,  the  interconnect  provided  by  the  hologram  will  converge  so  that  every  input 
A  is  mapped  to  the  desired  target  vector  B. 
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Figure  1  Schematic  for  hoiographic  Adaline  learning. 

In  the  course  of  our  experiments  we  found  that  in  practice  our  system  worked  well  for  three 
input  vectors,  it  worked  acceptably  for  eight  input  vectors,  but  it  would  not  converge  at  all  for  more 
than  eight  input  vectors. 

The  primary  problem  was  associated  with  the  liquid  crystal  spatial  light  modulator.  Its  char¬ 
acteristics  changed  rather  dramatically  over  time,  and,  worse,  in  a  history  dependent  manner.  That 
is,  its  current  transfer  function  would  depend  upon  what  information  it  had  recently  contained.  We 
concluded  that  a  much  improved  spatial  light  modulator  would  be  needed  for  further  progress. 

In  absence  of  better  spatial  light  modulator,  we  concluded  that  one  should  avoid  a  literal  trans¬ 
lation  of  a  given  model  to  its  opto-electronic  implementation.  Instead,  one  should  try  to  use  the 
dynamics  available  in  photorefractive  material  to  realize  the  functional  behavior  of  some  of  the 
more  biologically  motivated  models.  In  particular,  this  led  us  to  consider  models  of  acoustic  pro¬ 
cessing,  discused  in  section  4. 

B.2.Theory  of  the  holographic  two*port  operator 

Despite  the  experimental  difficulties  with  holographic  learning,  we  preceded  to  investigate 
theoretically  the  kinds  of  problems  likely  to  arise  from  the  holographic  process  itself.  From  the 
efforts  to  understand  the  formation  of  superimposed  holograms  in  photorefractive  materials  we 
have  formalized  a  particularly  important  notion;  Formally  the  hologaphic  crystal  can  be  treated  as 
a  two-port  linear  operator.  If  one  treats  the  material  as  a  collection  of  discrete  elements  the  operator 
takes  the  form  of  a  matrix;  for  the  continuum  case  the  operator  is  expressed  as  a  scattering  kernel. 
It  has  been  shown  that  the  matrix  elements,  or  the  kernel,  can  be  calculated  knowing  the  holograph¬ 
ic  grating  everywhere  within  the  crystal.  This  is  a  very  powerful  approach  to  take  when  investi¬ 
gating  the  output  of  a  holographic  grating  illuminated  with  optical  fields.  It  is  particularly  powerful 
when  applied  to  computer  modeling  of  ^e  optical  systems.  In  conjunction  with  the  modeling,  the 
first  version  of  an  object-oriented  computer  program  designed  to  run  on  a  DECstation  3  lOOwas  put 
into  operation.  This  program  uses  the  matrix  element  approach  to  the  photorefractive  gratings  to 
simulate  the  behavior  of  optical  circuits  composed  of  these  media. 

The  theoretical  treatment  allows  one  to  see  how  the  noise  and  error  terms  during  hologram 
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formation  come  into  being.  From  here,  one  can  determine  how  these  effects  play  upon  holographic 
learning,  and  how  problems  might  be  ameliorated. 

B ^.Impulse  response  and  transfer  function  of  photorefractive  two  beam  coupling 

As  we  discuss  further  in  section  4.  one  of  our  goals  was  to  understand  how  one  could  imple¬ 
ment  neural  models  of  acoustic  signal  processing  using  the  dynamic  of  photorefractive  materials. 
In  this  regard,  the  time-dependent  behavior  of  two-beam  coupling  needs  to  be  understood.  Perhaps 
the  most  significant  advance  in  this  investigation  was  the  derivation  of  the  Laplace  transfer  func¬ 
tion  of  two-beam  coupling  in  the  undepleted  pump  regime.  The  transfer  function  is  a  very  unusual 
one.  From  the  transfer  function  it  has  been  possible  to  obtain  a  closed-form  expression  for  the  im¬ 
pulse  response  funciton  of  the  two-beam  coupling  amplifier. 

The  impulse  response  function  is  characterized  by  a  delayed  pulse  response.  The  delay  time 
is  a  function  of  pump  beam  intensity.  Therefore,  one  can  program  a  delay  using  the  pump  intensity 
as  the  parameter. 

We  performed  a  series  of  experiments  measuring  directly  both  the  transfer  function  and  the 
impulse  response  of  two  beam  coupling  in  barium  titanate.  In  principle  the  two  sets  of  experimen¬ 
tal  data  for  ^e  impulse  response  and  transfer  functions  should  be  LaPlace  transforms  of  each  other. 
We  found  that  the  shapes  were  consistent  with  this  expectation,  but  that  they  differed  quantitatively 
by  a  factor  of  from  two  to  four.  After  some  investigation,  the  discrepancy  was  reco^ized  to  be  a 
manifestation  of  beam  fanning  (stimulated  scattering).  For  our  purposes,  the  quantitative  discrep¬ 
ancy  is  insignificant. 

The  delay  property  of  the  photorefractive  two  beam  coupling  impulse  response  has  interest¬ 
ing  implications  for  time  domain  optical  neural  networks.  In  particular,  we  have  studied  a  speech 
processing  network  demonstrated  by  Hopfield  and  Tank  that  uses  “learned”  time  delays  to  recog¬ 
nize  speech.  Hopfield  and  Tank  use  a  (simulated)  transmission  line  that  causes  pulse  spreading  as 
well  as  delay.  It  happens  that  the  two-beam  coupling  amplifier  has  exactly  this  kind  of  impulse 
response  function  --the  longer  the  delay,  the  wider  the  pulse,  but  the  area  under  the  response  re¬ 
mains  constant.  Furthermore,  the  intensity  dependence  of  the  impulse  response  allows  us  to  pro¬ 
gram  the  delay. 

B.4.Acoustic  transducer 

As  a  front  end  to  an  acoustic  signal  processor  it  is  convenient  to  obtain  a  Fourier  transform  of 
the  incoming  signal.  Although  there  are  a  number  of  digital  electronic  integrated  circuits  designed 
to  perform  this  task,  since  our  processing  is  optical  we  concluded  that  the  most  efficient  front  end 
would  consist  of  an  optical  transducer  that  directly  obtained  the  Fourier  transform  of  the  acoustic 
signal.  Accordingly,  we  built  an  optical  acoustic  signal  analyzer  composed  of  a  collection  of  120 
optical  fibers.  A  cantilevered  optical  fiber  is  a  mechanical  resonator.  Its  resonant  frequency  cOr 
depends  on  its  elastic  constants  and  its  physical  size.  In  particular,  cOr  is  inversely  proponional  to 
the  square  of  the  length  of  the  fiber.  Thus  an  array  of  cantilevered  optical  fibers  with  different 
lengths  can  be  viewed  as  a  spectrum  analyser.  As  shown  in  Fig.l,  the  acoustic  transducer  is  made 
of  such  an  array  of  optical  fibers  and  a  photorefractive  novelty  filter  The  resonant  frequencies 
of  the  fibers  logarithmically  sample  the  acoustic  spectrum  from  approximately  lOOHz  to  5kHz. 
Sound  signals  are  received  by  each  fiber  in  the  array.  Laser  light  is  injected  into  all  fibers  simul¬ 
taneously  and  is  reflected  from  the  end  of  each  fiber.  The  reflected  light  passes  through  a  photore¬ 
fractive  novelty  filter.  The  novelty  fiter  eliminates  the  optical  carrier  and  leaves  only  the 
acoustically  imposed  sidebands.  The  output  image  is  essentially  a  scrambled  Fourier  transform  of 
the  driving  signal. 

The  fibers  are  clamped  at  one  end  and  are  free  at  the  other,  thus  they  are  free  to  vibrate.  The 
lengths  are  set  so  that  the  resonant  frequencies  of  these  fiber  cantilevers  cover  the  acoustic  speech 
range  of  about  lOOHz  to  5KHz.  The  fibers  are  driven  by  a  bridge  (as  in  a  stringed  instrument)  con¬ 
nected  to  a  piezo  element.  The  free  ends  of  the  fibers  are  silver  coated  so  that  incident  light  is  re¬ 
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Figure  2.  Fiber  optic  acoustic  transducer.  The  fibers  act  as  mechanical  resonators  with  resonant  frequoK^  inversely 
proportional  to  the  inverse  square  of  their  lengths.  The  reflected  ouqiut  of  the  fibers  is  process  by  an  optical  novelty 
niter,  which  provides  the  Fourier  transform  of  the  acoustic  signal. 

fleeted.  Laser  light  propagates  along  each  fiber,  is  reflected,  and  exits  the  input  end.  This  output 
is  then  put  through  an  optical  novelty  Alter  (see  the  attached  Agure).  In  steady  state,  no  light  exits 
from  the  novelty  Alter.  When  a  given  Aber  vibrates,  however,  the  phase  of  its  light  is  m^ulated 
and  an  output  Aom  the  novelty  Alter  appears.  In  this  manner  a  Fourier  spectrum  of  the  acoustic 
signal  on  the  piezo  element  is  obtained  as  a  dot  pattern. 

To  combine  the  transducer  with  a  holographic  optical  processing  system,  we  have  designed 
a  scheme  to  store  sounds  in  a  single  LiNbOa  crystal.  The  experimental  set  up  is  as  in  Figure  3. 
When  a  sound  is  received  by  the  transducer,  it  generates  a  characteristic  vibrational  pattern  on  the 
Aber  array  and  a  corresponding  modulation  on  tiie  Aber  modes.  After  the  novelty  Alter,  the  optical 
carrier  is  suppressed,  and  only  the  acoustic  sidebands  are  left.  The  “acoustic  image”  thus  obtained 
is  used  to  write  a  hologram  with  a  reference  beam  of  light.  The  hologram  then  acts  as  a  matched 
Alter  for  the  sound,  and  allows  us  to  recognize  a  previously  stored  sound. 

The  reference  wave  must  also  contain  the  same  acoustic  sidebands  to  write  the  hologram  with 
the  transducer  output.  In  our  demonstration,  an  electro-optic  modulator  (EOM)  is  used  to  provide 
the  sidebands  on  ^e  reference  wave.  The  electro-optic  modulator  is  used  as  an  amplitude  modu¬ 
lator.  The  direction  of  the  output  polarizer  is  perpendicular  to  the  input  polarization,  so  that  the 
optical  carrier  is  suppressed  at  the  output.  The  electro-optic  modulator  and  the  acoustic  transducer 
are  simultaneously  driven  by  the  same  sound,  thus  a  grating  is  formed  in  the  holographic  crystal. 
By  angle  encoding  the  reference  wave,  one  can  store  several  holograms  in  a  single  LiNbO, crystal. 

We  have  written  two  angle-encoded  holograms  with  two  sounds.  Each  sound  has  a  stationary 
spectrum  and  is  synthesized  with  Ave  different  acoustic  frequencies. 
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FiguFe3.Thesu>fageoftheFouriertransfonnofsoundsinaphot(»efractivelithiumniobatecrystal,dopedwithin)n.0.01S%. 
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bands  preset  in  the  transducer  signal.  Each  sound  is  recorded  with  a  different  reference  wave. 


4.  A.  Hermanns,  D.  Lininger,  C.  Benkert  and  D.  Z.  Anderson,  “Impulse  response  and  transfer 
function  of  two-beam  coupling  amplifiers,”  IEEE  J.  Quant.  Electon.  (submitted). 

5.  G.  ^ou,  L.  Bintz,  and  D.  Z,  Anderson,  "A  fiber-optic  acoustic  Fourier  for  audio  sound  pro¬ 
cessing,"  Applied  Optics  (submitted). 

D.  Scientific  Personel 
D.l.  Postoctoral  Research  Associates 

Michael  J.  O’GiUahan 
Ju  Song  Jang 
David  D.  Crouch 

D.2.  Ph.D  Level  Students 

Gan  Zhou  (Ph.  D.  in  progress) 

Anno  Hermanns  (Ph.  D.  in  progress) 


page  7 


D3.  Undergraduate  Students 

Louis  Bintz  (Received  B.S.  Physics,  June.  1991) 


page  8 


Bibliography 


D.Z.  Anderson,  D.  Lininger  and  J.  Feinberg,  "Optical  tracking  novelty  filter,"  Opt  Lett  12,  123 
(1987). 

D.Z.  Anderson  and  D.M.  Lininger,  "Dynamic  optical  intexonnects:  volume  holograms  as  optical 
two-port  operators,"  Appl.  Opt.,  26, 5031  (1987)  (invited  paper). 

M.J.  0’(Zallaghan  and  D.Z.  Anderson,  "Spatial  light  modulators  for  optical  neuiomorphs,"  Proc. 
SPIE  conference  on  Spatial  Light  Modulators  and  Applications  II,  vol.  825, 121,(1987). 

D.Z.  Anderson  and  J.  Feinberg,  "Optical  novelty  filters,"  IEEE  J.  Quant.  Electron.  25, 635  (1989) 

B.  Widrow  and  S.  D.  Stems,  Adaptive  Signal  Processing,  Prentice  Hall,  Englewood  Cliffs  N.J. 
(1985). 


page  9 


